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DECLARATION AND POWER OF ATTORNEY - USA PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name; 

I believe I am an original, first and joint inventor of the subject matter which is claimed 
and for which a patent is sought on the invention entitled METHOD OF DISPLAYING 
SYSTEM STATUS; the specification of which is attached hereto; 

I hereby state that I have reviewed and understand the contents of the above identified 
specification, including the claims, as amended by any amendment referred to above; 

I acknowledge the duty to disclose information which is material to patentability as 
defined in Title 37, Code of Federal Regulations, § 1.56; 

I hereby claim the benefit under Title 35, United States Codes § 119(e) of any United 
States provisional application(s) listed below. 

Application No.: 60/046,326 Filing Date: May 13, 1997 

Application No.: 60/046,397 Filing Date: May 13, 1997 

Application No.: 60/047,016 Filing Date: May 13, 1997 

Application No.: 60/046,416 Filing Date: May 13, 1997 

POWER OF ATTORNEY: I hereby appoint the following attorneys and/or agents to prosecute 
this application and to transact all business in the Patent and Trademark Office connected 
therewith (if this application is assigned, I acknowledge that the appointed individuals do not 
represent me, and that instead they represent the assignee): Louis J. Knobbe, Registration No. 
18,780; Don W. Martens, Registration No. 21,107; Gordon H. Olson, Registration No. 20,319; 
James B. Bear, Registration No. 25,221; Darrell L. Olson, Registration No. 28,247; William 
B. Bunker, Registration No. 29,365; William H. Nieman, Registration No. 30,201; Lowell 
Anderson, Registration No. 30,990; Arthur S. Rose, Registration No. 28,038; James F. Lesniak, 
Registration No. 25,240; Ned A. Israelsen, Registration No. 29,655; Drew S. Hamilton' 
Registration No. 29,801; Jerry T. Sewell, Registration No. 31,567; John B. Sganga, Jr., 
Registration No. 31,302; Edward A. Schlatter, Registration No. 32,297; Gerard von Hofifinann, 
Registration No. 33,043; Joseph R. Re, Registration No. 31,291; John M. Carson, Registration 
No. 34,303; Andrew H. Simpson, Registration No. 31,469; Daniel E. Altman, Registration No. 
34,115; Anita M. Kirkpatrick, Registration No. 32,617; Ernest A. Beutler, Registration No. 
19,901; Vito A. Canuso, Registration No. 35,471; William H. Shreve, Registration No. 35,678; 
Stephen C. Jensen, Registration No. 35,556; Steven J. Nataupsky, Registration No. 37,688; 
Michael H. Trenholm, Registration No. 37,743; Craig S. Summers, Registration No. 31,430; 
AnneMarie Kaiser, Registration No. 37,649; Brenton R. Babcock, Registration No. 39,592- 
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Nancy Ways Vensko, Registration No. 36,298; Jonathan A. Barney, Registration No. 34,292; 
Ronald J. Schoenbaum, Registration No. 38,297; Richard C. Gihnore, Registration No. 37'335; 
John R. King, Registration No. 34,362; William S. Reimus, Registration No. 38,279; Christine 
A. Gritzmacher, Registration No. 40,627; John P. Giezentanner, Registration No. 39,993; Adeel 
S. Akhtar, Registration No. 41,394; Frederick S. Berretta, Registration No. 38,004; Thomas R. 
Amo, Registration No. 40,490; David N. Weiss, Registration No. 41,371; James T. Hagler, 
Registration No. 40,631; Dan Hart, Registration No. 40,637; Lori L. Yamato, Registration No! 
40,881, Moses Mares, Registration No. 40,716; Stephen M. Lobbin, Registration No. 41,159; 
Richard Kim, Registration No. 40,046; Robert F. Gazdzinski, Registration No. 39,990; R. Scott 
Weide, Registration No. 37,755; Katherine W. White, Registration No. 37,470; Richard E. 
Campbell, Registration No. 34,790; Raimond J. Salenieks, Registration No. 37,924; Renee E. 
Cauuso, Registration No. 36,657; Michael L. Fuller, Registration No. 36,516; Neil S. Bartfeld, 
Registration No. 39,901; and Daniel E. Johnson, Registration No. 37,033. 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United 
States Code and that such v^^Uful, false statements may jeopardize the validity of the 
application or any patent issued thereon. 
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Related Applications 

This application is related to U.S. Appliation No. , entitled 

"SYSTEM FOR POWERING UP AND POWERING DOWN A SERVER". Attorney 

Docket No. MNFRAME.018A; U.S. Application No. , entitled "METHOD 

OF POWERING UP AND POWERING DOWN A SERVER", Attorney Docket No. 

MNFRAME.019A; U.S. Application No. , entitled "SYSTEM FOR 

RESETTING A SERVER", Attorney Docket No. MNFRAME.020A; U.S. Application 

No. , entitled "METHOD OF RESETTING A SERVER", Attorney Docket 

No. MNFRAME.021A; U.S. Application No. , entitled "SYSTEM FOR 

DISPLAYING FLIGHT RECORDER", Attorney Docket No. MNFRAME.022A; U.S. 

Application No. , entitled "METHOD OF DISPLAYING FLIGHT 

RECORDER", Attorney Docket No. MNFRAME.023A; U.S. Application 

No. , entitled "SYSTEM FOR DISPLAYING SYSTEM STATUS", 

Attorney Docket No. MNFRAME.044A, which are being filed concurrently herewith 
on October 1, 1997. 



20 Priority Claim 

The benefit under 35 U.S.C. § 119(e) of the following U.S. provisional 
application(s) is hereby claimed: 

Title Application Filing Date 

No. 

"Remote Software for Monitoring and 60/046,326 May 13, 1997 
25 Managing Environmental Management 
System" 

"Remote Access and Control of Environmental 60/046,397 May 13, 1997 
Management System" 

"Hardware and Software Architecture for 60/047,016 May 13, 1997 
30 Inter-Connecting an Environmental 

Management System with a Remote Interface" 



Title Application Filing Date 

No. 

"Self Management Protocol for a Fly-By- Wire 60/046,416 May 13, 1997 
Service Processor" 



Appendices 

Appendix A, which forms a part of this disclosure, is a list of commonly 
owned copending U.S. patent applications. Each one of the applications listed in 
Appendix A is hereby incorporated herein in its entirety by reference thereto. 



Copyright Rights 

A portion of the disclosure of this patent document contains material which is 
subject to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears 
in the Patent and Trademark Office patent files or records, but otherwise reserves all 
copyright rights whatsoever. 



Background of the Invention 

Field of the Invention 

The present invention relates to fauh tolerant computer systems. More 
specifically, the invention is directed to a system for providing remote access and 
control of server enviroiunental management. 

Description of the Related Technolopv 

As enterprise-class servers become more powerful and more capable, they are 
also becoming increasingly sophisticated and complex. For many companies, these 
changes lead to concerns over server reliability and manageability, particularly in light 
of the increasingly critical role of server-based applications. While in the past many 
systems administrators were comfortable with all of Ihe various components that made 
up a standards-based network server, today's generation of servers can appear as an 
incomprehensible, unmanageable black box. Without visibility into the underlying 



behavior of the system, the administrator must "fly blind." Too often the only 
indicators the network manager has on the relative health of a particular server is 
whether or not it is running. 

It is well-acknowledged that there is a lack of reliability and availability of 
most standards-based servers. Server downtime, resulting either from hardware or 
software faults or from regular maintenance, continues to be a significant problem. 
By one estimate, the cost of downtime in mission critical environments has risen to 
an annual total of $4.0 billion for U.S. businesses, with the average downtime event 
resulting in a $140 thousand loss in the retail industry and a $450 thousand loss in the 
securities industry. It has been reported that companies lose as much as $250 
thousand in employee productivity for every 1% of computer downtime. With 
emerging Internet, intranet and collaborative applications taking on more essential 
business roles every day, the cost of network server downtime will continue to spiral 
upward. 

While hardware fault tolerance is an important element of an overall high 
availability architecture, it is only one piece of the puzzle. Studies show that a 
significant percentage of network server downtime is caused by transient faults in the 
I/O subsystem. These faults may be due, for example, to the device driver, the 
adapter card firmware, or hardware which does not properly handle concurrent errors, 
and often causes servers to crash or hang. The result is hours of downtime per failure, 
while a system administrator discovers the failure takes some action, and manually 
reboots the server. In many cases, data volumes on hard disk drives become corrupt 
and must be repaired when the volume is mounted. A dismount-and-mount cycle may 
result from the lack of "hot pluggability" in current standards-based servers. 
Diagnosing intermittent errors can be a frustrating and time-consuming process. For 
a system to deliver consistently high availability, it must be resilient to these types of 
faults. Accurate and available information about such faults is central to diagnosing 
the underlying problems and taking corrective action. 

Modem fault tolerant systems have the fimctionality to provide the ambient 
temperature of a storage device enclosure and the operational status of other 
components such as the cooling fans and power supply. However, a limitation of 



these server systems is that they do not contain self-managing processes to correct 
malfunctions. Also, if a malfunction occurs in a typical server, it relies on the 
operating system software to report, record and manage recovery of the fault, 
Hov^ever, many types of faults will prevent such software from carrying out these 
5 tasks. For example, a disk drive failure can prevent recording of the fault in a log file 

on that disk drive. If the system error caused the system to power down, then the 
system administrator would never know the source of the error. 

Traditional systems are lacking in detail and sophistication when notifying 
system administrators of system malfunctions. System administrators are in need of 

10 a graphical user interface for monitoring the health of a network of servers. 
Admmistrators need a simple point-and-click interface to evaluate the health of each 
server in the network. In addition, existing fault tolerant servers rely upon operating 
system maintained logs for error recording. These systems are not capable of 
maintaining information when the operating system is inoperable due to a system 

15 malfunction. Existing systems do not have a system log for maintaining information 
when the main computational processors are inoperable or the operating system has 
crashed. 

Another Ihnitation of the typical fault tolerant system is that the control logic 
for the diagnostic system is associated with a particular processor. Thus, if the - 

20 environmental control processor malfiinctioned, then all diagnostic activity on the 
computer would cease. In traditional systems, if a controller dedicated to the fan 
system failed, then all fan activity could cease resulting in overheating and ultimate 
failure of the server. What is desired is a way to obtain diagnostic information when 
the server OS is not operational or even when main power to the server is down. 

25 Existing fault tolerant systems also lack the power to remotely control a 

particular server, such as powering up and down, resetting, retrieving or updating 
system status, displaying flight recorder information and so forth. Such control of the 
server is desired even when the server power is down. For example, if the operating 
system on the remote machine failed, then a system administrator would have to 

30 physically go to the remote machine to re-boot the malfunctioning machine before any 
system information could be obtained or diagnostics could be started. 
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Therefore, a need exists for improvements in server management which will 
result in greater reliability and dependability of operation. Server users are in need 
of a management system by which the users can accurately gauge the health of their 
system. Users need a high availability system that must not only be resilient to 
faults, but must allow for maintenance, modification, and growth-without downtime. 
System users must be able to replace failed components, and add new functionality, 
such as new network interfaces, disk interface cards and storage, without impacting 
existing users. As system demands grow, organizations must frequently expand, or 
scale, their computing infrastructure, adding new processing power, memory, storage 
and I/O capacity. With demand for 24-hour access to critical, server-based 
information resources, planned system downtune for system service or expansion has 
become unacceptable. 

Summary of the Invention 
The inventive remote access system provides system administrators with new 
levels of client/server system availability and management. It gives system 
administrators and network managers a comprehensive view into the underlying health 
of the server-in real time, whether on-site or off-site. In the event of a failure, the 
invention enables the administrator to learn why the system failed, why the system 
was unable to boot, and to control certain functions of the server from a remote 
station. 

One embodiment of the present invention is a method for retrieving or updating 
system status for a computer, the method comprising the acts of: sending a command 
for remotely retrieving or updating system status from a second computer through a 
remote interface to a first computer; executing the command on a microcontroller in 
the first computer; and sending a retrieve or update system status signal from the 
microcontroller to the first computer thereby retrieving or updating the system status. 

Another embodiment of the present invention is a method of retrieving or 
updating system status for a computer, the method comprising the acts of connecting 
a remote interface to a first computer and a second computer; providing a retrieving 
or updating system status command at the second computer directed to the first 



computer; encapsulating the command in a communications protocol; transmitting the 
encapsulated command to the remote interface; conmiunicating the command received 
by the remote interface to the first computer; and performing the command on the first 
computer. 

Yet another embodiment of the present invention is a method of external 
management of a computer environment, the method comprising the acts of providing 
a first computer; providing a second computer; selecting, at the second computer, a 
component of the first computer to be managed; selecting, at the second computer, a 
management operation to be performed by the first computer on the selected 
component; conununicating the selected component and selected operation from the 
second computer to the first computer; and performing the selected operation on the 
selected component at the first computer. 

Brief Description of the Drawings 

Figure 1 is a top level block diagram of a server system having a 
microcontroller network in communication with a local client computer or a remote 
client computer utilized by one embodiment of the present invention. 

Figure 2 is a detailed block diagram of the microcontroller network shown in 
Figure 1. 

Figure 3 is a diagram of serial protocol message formats utilized in 
communications between the client computer and remote interface shown in Figures 
1 and 2. 

Figures 4a and 4b are one embodiment of a flow diagram of a power-on 
process performed by the microcontroller network and client computer of Figures 1 
and 2. 

Figure 5 is one embodiment of a flow diagram of the power-on function shown 
in Figure 4b. 

Figures 6a and 6b are one embodiment of a flow diagram of a power-off 
process performed by the microcontroller network and client computer of Figures 1 
and 2. 



Figure 7 is one embodiment of a flow diagram of the power-off function 
shown in Figure 6b. 

Figures 8a and 8b are one embodiment of a flow diagram of a reset process 
performed by the microcontroller network and client computer of Figures 1 and 2. 
5 Figure 9 is one embodiment of a flow diagram of the reset function shown in 

Figure 8b. 

Figures 10a and 10b are one embodiment of a flow diagram of a display flight 
recorder process performed by the microcontroller network and client computer of 
Figures 1 and 2. 

10 Figure 1 1 is one embodiment of a flow diagram of the read non-volatile RAM 

(NVRAM) contents function shown in Figure 10b. 

Figures 12a, 12b and 12c are a detailed block diagram of the microcontroller 
network components showing a portion of the inputs and outputs of the 
microcontrollers shown in Figure 2. 
'^2 15 Figures 13a and 13b are one embodiment of a flow diagram of a system status 

|1J process performed by the microcontroller network and client computer of Figures 1 

H and 2. 

1^ Figure 14 is one embodiment of a flow diagram of the system status function 

shown in Figure 13b. 

J5 20 Figure 15 is an exemplary screen display of a server power-on window seen 

1-^ at the client computer to control the microcontroller network of Figures 1 and 2. 

Cj Figure 16 is an exemplary screen display of a flight recorder window seen at 

the client computer to control the microcontroller network of Figures 1 and 2. 

Figxire 17 is an exemplary screen display of a system status window seen at the 
25 client computer to control the microcontroller network of Figures 1 and 2. 

Figure 18 is an exemplary screen display of a system status:fans window seen 
at the client computer to control the microcontroller network of Figures 1 and 2. 

Figure 19 is an exemplary screen display of a system status:fans:canister A 
window seen at the client computer to control the microcontroller network of Figures 
30 1 and 2. 
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Detailed Description of the Invention 
The following detailed description presents a description of certain specific 
embodiments of the present invention. However, the present invention can be 
embodied in a multitude of different ways as defined and covered by the claims. In 
5 this description, reference is made to the drav^ngs wherein like parts are designated 
with like numerals throughout 

For convenience, the description mil be organized into the foUov^ng principal 
sections: Introduction, Server System, Microcontroller Network, Remote Interface 
Serial Protocol, Power-On Flow, Power-Off Flow, Reset Flow, Flight Recorder Flow, 
10 and System Status Flow, 

L INTRODUCTION 
The inventive computer server system and client computer includes a 
distributed hardware envu-onment management system that is buih as a small self- 

15 contained network of microcontrollers. Operating independently of the system 
processor and operating software, the present invention uses one or more separate 
processors for providing information and managing the hardware environment that 
may include fans, power supplies and/or temperature. 

One embodiment of the present invention facilitates remotely powering-on and - 

20 powering-off of the server system by use of a client computer. The client computer 
may be local to the server system, or may be at a location remote from the server 
system, in which case a pair of modems are utilized to provide communication 
between the client computer and the server system. A remote interface board connects 
to the server and interfaces to the server modem. Recovery manager software is 

25 loaded on the client computer to control the power-on and power-off processes and 
to provide feedback to a user though a graphical user interface. 

Another embodiment of the present invention facilitates remotely resetting the 
server system by use of the client computer. Resetting the server system brings the 
server and operating system to a normal operating state. Recovery manager software 

30 is loaded on the client computer to control the resetting process and to provide 
feedback to a user though a graphical user interface. 

-8- 



Another embodiment of the present invention provides for a system log, known 
as a "flight recorder," which records hardware component failure and software crashes 
in a Non-Volatile RAM. With real time and date referencing, the system recorder 
enables system administrators to re-construct system activity by accessing the log. 
This information is very helpfiil in diagnosing the server system. 

Initialization, modification and retrieval of system conditions is performed 
through utilization of a remote interface by issuing commands to the environmental 
processors. The system conditions may include system log size, presence of faults in 
the system log, serial number for each of the environmental processors, serial numbers 
for each power supply of the system, system identification, system log count, power 
settings and presence, canister presence, temperature, BUS/CORE speed ratio, fan 
speeds, settings for fan faults, LCD display, Non-Maskable Interrupt (NMI) request 
bits, CPU fault summary, FRU status, JTAG enable bit, system log information, 
remote access password, over-temperature fault, CPU error bits, CPU presence, CPU 
thermal fault bits, and remote port modem. The aforementioned list of capabilities 
provided by the present environmental system is not all-inclusive. 

The server system and client computer provides mechanisms for the evaluation 
of the data that the system collects and methods for the diagnosis and repair of server 
problems in a manner that system errors can be effectively and efficiently managed. 
The time to evaluate and repair problems is minimized. The server system ensures 
that the system will not go down, so long as sufficient system resources are available 
to continue operation, but rather degrade gracefiiUy until the faulty components can 
be replaced. 

II. SERVER SYSTEM 
Referring to Figure 1, a server system 100 with a client computer will be 
described. In one embodiment, the server system hardware environment 100 may be 
built around a self-contained network of microcontrollers, such as, for example, a 
remote interface microcontroller on the remote interface board or circuit 104, a system 
interface microcontroller 106 and a system recorder microcontroller 110. This 
distributed service processor network 102 may operate as a fully self-contained 



subsystem within the server system 100, continuously monitoring and managing the 
physical environment of the machine (e.g., temperature, voltages, fan status). The 
microcontroller network 102 continues to operate and provides a system administrator 
with critical system information, regardless of the operational status of the server 100, 
5 Information collected and analyzed by the microcontroller network 102 can be 

presented to a system administrator using either SNMP-based system management 
software (not shown), or using microcontroller network Recovery Manager software 
130 through a local connection 121 or a dial-in connection 123. The system 
management software, which interfaces with the operatmg software (OS) 108 such as 
10 Microsoft Windows NT Version 4.0 or Novell Netware Version 4.11, for example, 
provides the ability to manage the specific characteristics of the server system, 
including Hot Plug Peripheral Component Interconnect (PCI), power and cooling 
status, as well as the ability to handle alerts associated v^th these features when the 
:^ server is operational. 

15 The microcontroller network Recovery Manager software 130 allows the 

flj system administrator to query the status of the server system 100 through the 

y microcontroller network 102, even when the server is down. In addition, the server 

1^ Operating Software 108 does not need to be running to utilize the Recovery Manager 

1,^ 130. Users of the Recovery Manager 130 are able to manage, diagnose and restore 

y 20 service to the server system quickly in the event of a failure through a friendly 

U graphical user interface (GUI). 

Ij Using the microcontroller network remote management capability, a system 

administrator can use the Recovery Manager 130 to re-start a failed system through 
a modem connection 123. First, the administrator can remotely view the 

25 microcontroller network Flight Recorder, a feature that may, in one embodiment, store 

all system messages, status and error reports in a circular System Recorder memory. 
In one embodiment, the System Recorder memory may be a Non- Volatile Random 
Access Memory buffer (NVRAM) 112. Then, after determining the cause of the 
system problem, the administrator can use microcontroller network "fly by wire" 

30 capability to reset the system, as well as to power the system off or on. "Fly by wire" 
denotes that no svwtch, indicator or other control is directly connected to the function 
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it monitors or controls, but instead, all the control and monitoring connections are 
made by the microcontroller network 102. 

The remote interface or remote interface board (RIB) 104 interfaces the server 
system 100 to an external client computer. The RIB 104 connects to either a local 
client computer 122 at the same location as the server 100 or to a remote client 
computer 124 either directly or through an optional switch 120. The client computer 
122/124 may in one embodiment run either Microsoft Windows 95 or Windows NT 
Workstation version 4.0 operating software (OS) 132. The processor and RAM 
requirements of the client computer 122/124 are such as may be specified by the 
vendor of the OS 132. The serial port of the client computer 122/124 may utilize a 
type 16550A Universal Asynchronous Receiver Transmitter (UART). The switch 
facilitates either the local connection 121 or the modem connection 123 at any one 
time, but allows both types of connections to be connected to the switch. In an 
another embodiment, either the local connection 121 or the modem connection 123 is 
connected directly to the RIB 104. The local connection 121 utilizes a readily 
available null-modem serial cable to connect to the local client computer. The modem 
connection may utiUze a Hayes-compatible server modem 126 and a Hayes-compatible 
client modem 128. In one embodiment, a model fax modem V.34X 33.6K available 
from Zoom is utilized as the client modem and the server modem. In another 
embodiment, a Sportster 33.6K fax modem available from US Robotics is utilized as 
the client modem. 

The steps of connecting the remote client computer 124 to the server 100 will 
now be briefly described. The remote interface 104 has a serial port connector (not 
shown) that directly connects with a counterpart serial port connector of the external 
server modem 126 without the use of a cable. If desired, a serial cable could be used 
to interconnect the remote interface 104 and the server modem 126. The cable end 
of an AC to DC power adapter (not shown, for example 120 Volt AC / 7.5 Volt DC) 
is then connected to a DC power connector (not shown) of the remote interface, while 
the double-prong end is plugged into a 120 Volt AC wall outlet. One end of an RJ-45 
parallel-wire data cable 103 is then plugged into an RJ-45 jack (not shown) on the 
remote interface 104, while the other end is plugged into a RJ-45 Recovery Manager 



jack on the server 100. The RJ-45 jack on the server then connects to the 
microcontroller network 102, The server modem 126 is then connected to a 
communications network 127 using an appropriate connector. The communications 
network 127 may be a public sv^tched telephone network, although other modem 
types and communication networks are envisioned. For example, if cable modems are 
used for the server modem 126 and client modem 128, the communications network 
can be a cable television network. As another example, satellite 
modulator/demodulators can be used in conjunction with a satellite network. 

In another embodiment, the server modem to client modem connection may be 
implemented by an Internet connection utilizing the well known TCP/IP protocol. 
Any of several Internet access devices, such as modems or network interface cards, 
may be utilized. Thus, the communications network 127 may utilize either circuit or 
packet switching. 

At the remote client computer 124, a serial cable (for example, a 25-pin D- 
shell) 129 is used to interconnect the client modem 128 and the client computer 124. 
The client modem 128 is then connected to the communications network 127 using 
an appropriate connector. Each modem is then plugged into an appropriate power 
source for the modem, such as an AC outlet. At this time, the Recovery Manager 
software 130 is loaded into the client computer 124, if not already present, and 
activated. 

The steps of connecting the local client computer 122 to the server 100 are 
similar, but modems are not necessary. The main difference is that the serial port 
connector of the remote interface 104 connects to a serial port of the local client 
computer 122 by the null-modem serial cable 121. 

III. MICROCONTROLLER NETWORK 
In one embodiment, the current invention may include a network of 
microcontrollers 102 (Figure 1). The microcontrollers may provide functionality for 
system control, diagnostic routines, self-maintenance control, and event logging 
processors. A fiirther description of the microcontrollers and microcontroller network 
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is provided in U.S. Patent Application No. , entitled "Diagnostic 

and Managing Distributed Processor System". 

Referring to Figure 2, in one embodiment of the invention, the network of 
microcontrollers 102 includes ten processors. One of the purposes of the 
microcontroller network 102 is to transfer messages to the other components of the 
server system 100. The may processors include: a System Interface controller 106, 
a CPU A controller 166, a CPU B controller 168, a System Recorder 110, a Chassis 
controller 170, a Canister A controller 172, a Canister B controller 174, a Canister C 
controller 176, a Canister D controller 178 and a Remote Interface controller 200. 
The Remote Interface controller 200 is located on the RIB 104 (Figure 1) which is 
part of the server system 100, but may be external to a server enclosure. The System 
Interface controller 106, the CPU A controller 166 and the CPU B controller 168 are 
located on a system board 150 (also sometimes called a motherboard) in the server 
100. Also located on the system board are one or more central processing xmits 
(CPUs) or microprocessors 164 and an Industry Standard Architecture (ISA) bus 162 
that connects to the System Interface Controller 106. Of course, other buses such as 
PCI, EISA and MicroChannel may be used. The CPU 164 may be any conventional 
general purpose single-chip or multi-chip microprocessor such as a Pentium®, 
Pentium® Pro or Pentium® II processor available from Intel Corporation, a SPARC 
processor available from Sun Microsystems, a MIPS® processor available from Silicon 
Graphics, Inc., a Power PC® processor available from Motorola, or an ALPHA® 
processor available from Digital Equipment Corporation. In addition, the CPU 164 
may be any conventional special purpose microprocessor such as a digital signal 
processor or a graphics processor. 

The System Recorder 110 and Chassis controller 170, along with the System 
Recorder memory 112 that connects to the System Recorder 110, may be located on 
a backplane 152 of the server 100. The System Recorder 110 and Chassis controller 
170 are the first microcontrollers to power up when server power is applied. The 
System Recorder 110, the Chassis controller 170 and the Remote Interface 
microcontroller 200 (on the RIB) are the three microcontrollers that have a bias 5 Volt 
power supplied to them. If main server power is off, an independent power supply 
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source for the bias 5 Volt power is provided by the RIB 104 (Figure 1). The Canister 
controllers 172-178 are not considered to be part of the backplane 152 because they 
are located on separate cards which are removable from the backplane 152, 

Each of the microcontrollers has a unique system identifier or address. The 
5 addresses are as follows in Table 1 : 

TABLE 1 



Microcontroller 


Address 


System Interface controller 106 


10 


CPU A controller 166 


03 


CPU B controller 168 


04 


System Recorder 110 


01 


Chassis controller 170 


02 


Canister A controller 172 


20 


Canister B controller 174 


21 


Canister C controller 176 


22 


Canister D controller 178 


23 


Remote Interface controller 200 


11 



^^^^ 

20 The microcontrollers may be Microchip Technologies, Inc. PIC processors in 

1^ one embodiment, although other microcontrollers, such as an 8051 available from 

5 Intel, an 8751, available from Atmel, or a P80CL580 microprocessor available firom 

Philips Semiconductor, could be utilized. The PIC16C74 (Chassis controller 170) and 
PIC16C65 (the other controllers) are members of the PIC16CXX family of high- 
25 performance CMOS, fully-static, EPROM-based 8-bit microcontrollers. The PIC 
controllers have 192 bytes of RAM, in addition to program memory, three 
timer/counters, two capture/compare/Pulse Width Modulation modules and two serial 
ports. The synchronous serial port is configured as a two-wire Inter-Integrated Circuit 
(PC) bus in one embodiment of the invention. The PIC controllers use a Harvard 
30 architecture in which program and data are accessed from separate memories. This 
improves bandwidth over traditional von Neumann architecture controllers where 
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program and data are fetched from the same memory. Separating program and data 
memory further allows instructions to be sized differently than the 8-bit wide data 
word. Instruction opcodes are 14-bit wide making it possible to have all single word 
instructions. A 14-bit wide program memory access bus fetches a 14-bit instruction 
in a single cycle. 

In one embodiment of the invention, the microcontrollers conmiunicate through 
an I^C serial bus, also referred to as a microcontroller bus 160. The document "The 
Bus and How to Use It" (Philips Semiconductor, 1992) is hereby incorporated by 
reference. The PC bus is a bidirectional two-wire bus and operates at a 400 kbps rate 
in the present embodiment. However, other bus structures and protocols could be 
employed in connection with this invention. For example, the Apple Computer ADB, 
Universal Serial Bus, IEEE-1394 (Firewire), IEEE-488 (GPIB), RS-485, or Controller 
Area Network (CAN) could be utilized as the microcontroller bus. Control on the 
microcontroller bus is distributed. Each microcontroller can be a sender (a master) or 
a receiver (a slave) and each is interconnected by this bus. A microcontroller directly 
controls its own resources, and indirectly controls resources of other microcontrollers 
on the bus. 

Here are some of the features of the PC-bus: 

Two bus lines are utilized: a serial data line (SDA) and a serial clock line 
(SCL). 

• Each device connected to the bus is software addressable by a unique address 
and simple master/slave relationships exist at all times; masters can operate as 
master-transmitters or as master-receivers. 

• The bus is a true multi-master bus including collision detection and arbitration 
to prevent data corruption if two or more masters simultaneously initiate data 
transfer. 

Serial, 8-bit oriented, bidirectional data transfers can be made at up to 400 
kbit/second in the fast mode. 

Two wires, serial data (SDA) and serial clock (SCL), carry information 
between the devices connected to the f C bus. Each device is recognized by a unique 
address and can operate as either a transmitter or receiver, depending on the function 
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of the device. For example, a memory device comiected to the f C bus could both 
receive and transmit data. In addition to transmitters and receivers, devices can also 
be considered as masters or slaves v^hen performing data transfers (see Table 2), A 
master is the device which initiates a data transfer on the bus and generates the clock 
signals to permit that transfer. At that time, any device addressed is considered a 
slave. 



Term 

Transmitter 
Receiver 
Master 

Slave 

Multi-master 
Arbitration 



Synchronization 



TABLE 2 Definition of PC-bus terminology 

Description 

The device which sends the data to the bus 
The device which receives the data from the bus 
The device which initiates a transfer, generates clock 
signals and terminates a transfer 
The device addressed by a master 
More than one master can attempt to control the bus at 
the same time without corrupting the message 
Procedure to ensure that, if more than one master 
simultaneously tries to control the bus, only one is 
allowed to do so and the message is not corrupted 
Procedure to synchronize the clock signal of two or more 
devices 



The I^C-bus is a multi-master bus. This means that more than one device 
capable of controlling the bus can be connected to it. As masters are usually 
microcontrollers, consider the case of a data transfer between two microcontrollers 
connected to the I^C-bus. This highlights the master-slave and receiver-transmitter 
relationships to be found on the I^C-bus, It should be noted that these relationships 
are not permanent, but depend on the direction of data transfer at that time. The 
transfer of data would proceed as follows: 

1) Suppose microcontroller A wants to send information to microcontroller B: 
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microcontroller A (master), addresses microcontroller B (slave); 
microcontroller A (master-transmitter), sends data to microcontroller B 
(slave-receiver); 

microcontroller A terminates the transfer. 

2) If microcontroller A wants to receive information from microcontroller B: 
microcontroller A (master) addresses microcontroller B (slave); 
microcontroller A (master-receiver) receives data from microcontroller 
B (slave-transmitter); 
microcontroller A terminates the transfer. 

Even in this situation, the master (microcontroller A) generates the timing and 
terminates the transfer. 

The possibility of connecting more than one microcontroller to the PC-bus 
means that more than one master could try to initiate a data transfer at the same time. 
To avoid the chaos that might ensue from such an event, an arbitration procedure has 
been developed. This procedure relies on the wired-AND connection of all 
interfaces to the PC-bus. 

If two or more masters try to put information onto the bus, the first to produce 
a 'one' when the other produces a 'zero' will lose the arbitration. The clock signals 
during arbitration are a synchronized combination of the clocks generated by the 
masters using the v^red-AND connection to the SCL line. 

Generation of clock signal on the PC-bus is the responsibility of master 
devices. Each master microcontroller generates its own clock signals when 
transferring data on the bus. 

The command, diagnostic, monitoring and history functions of the 
microcontroller network 102 are accessed using a global network memory model in 
one embodiment. That is, any function may be queried simply by generating a 
network "read" request targeted at the function's known global network address. In 
the same fashion, a function may be exercised simply by "writing" to its global 
network address. Any microcontroller may initiate read/write activity by sending a 
mess^e on the I^C bus to the microcontroller responsible for the function (which can 
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be determined from the known global address of the function). The network memory 
model includes typing information as part of the memory addressing information. 

Using a network global memory model in one embodiment places relatively 
modest requirements for the message protocol. 

► All messages conform to the PC message format including addressing and 
read/write indication. 

► All I^C messages use seven bit addressing. 

► Any controller can originate (be a Master) or respond (be a Slave). 

► All message transactions consist of PC "Combined format" messages. This is 
made up of two back-to-back PC simple messages with a repeated START 
condition between (which does not allow for re-arbitrating the bus). The first 
message is a Write (Master to Slave) and the second message is a Read (Slave 
to Master), 

► Two types of transactions are used: Memory-Read and Memory- Write, 

► Sub-Addressing formats vary depending on data type being used. 

IV. REMOTE INTERFACE SERIAL PROTOCOL 
The microcontroller network remote interface serial protocol conmnmicates 
microcontroller network messages across a point-to-point serial link. This link is ^ 
between the RIB controller 200 that is in communication with the Recovery Manager 
130 at the remote client 122/124. This protocol encapsulates microcontroller network 
messages in a transmission packet to provide error-free communication and link 
security. 

In one embodiment, the remote interface serial protocol uses the concept of 
byte stuffing. This means that certain byte values in the data stream have a particular 
meaning. If that byte value is transmitted by the underlying application as data, it 
must be transmitted as a two-byte sequence. 

The bytes that have a special meaning in this protocol are: 

SOM 206 Start of a message 

EOM 216 End of a message 
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SUB 



The next byte in the data stream must be substituted 
before processing. 
Event Interrupt 

An entire microcontroller network message 



INT 220 



Data 212 



As stated above, if any of these byte values occur as data in a message, a two- 
byte sequence must be substituted for that byte. The sequence is a byte with the value 
of SUB, followed by a type with the value of the original byte, which is incremented 
by one. For example, if a SUB byte occurs in a message, it is transmitted as a SUB 
followed by a byte that has a value of SUB+1. 

Referring to Figure 3 the two types of messages 201 used by the remote 
interface serial protocol will be described. 

1. Requests 202, which are sent by remote management (client) computers 
122/124 (Figure 1) to the remote interface 104. 

2. Responses 204, which are returned to the requester 122/124 by the 
remote interface 104. 

The fields of the messages are defined as follows: 

SOM 206 A special data byte value marking the start of a message. 

EOM 216 A special data byte value marking the end of a message. 

Seq.# 208 A one-byte sequence number, which is incremented on 



TYPE 210 



each request. It is stored in the response. 
One of the following types of requests: 



IDENTIFY 



Requests the remote interface to send back identification 
information about the system to which it is connected. 
It also resets the next expected sequence number. 
Security authorization does not need to be established 
before the request is issued. 



SECURE 



Establishes secure authorization on the serial link by 
checking password security data provided in the message 
with the microcontroller network password. 



-19- 



UNSECURE Clears security authorization on the link and attempts to 
disconnect it. This requires security authorization to 
have been previously established. 

MESSAGE Passes the data portions of the message to the 
microcontroller network for execution. The response 
from the microcontroller network is sent back in the data 
portion of the response. This requires security 
authorization to have been previously established. 

POLL Queries the status of the remote interface. This request 

is generally used to determine if an event is pending in 
the remote interface. 
STATUS 218 One of the following response status values: 

OK Everything relating to communication with the remote 

interface is successful. 

OK_EVENT Everything relating to communication with the remote 
interface is successful. In addition, there is one or more 
events pending in the remote interface. 

SEQUENCE The sequence number of the request is neither the 
current sequence number or retransmission request, nor 
the next expected sequence number or new request. 
Sequence nimibers may be reset by an IDENTIFY 
request. 

CHECK The check byte in the request message is received 
incorrectly. 

FORMAT Something about the format of the message is incorrect. 

Most likely, the type field contains an invalid value. 
SECURE The message requires that security authorization be in 

effect, or, if the message has a TYPE value of SECURE, 

the security check failed. 
Check 214 Indicates a message integrity check byte. Currently the 

value is 256 minus the sum of previous bytes in the 
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message. For example, adding all bytes in the message 
up to and including the check byte should produce a 
result of zero (0). 

INT 220 A special one-byte message sent by the remote interface 

when it detects the transition from no events pending to 
one or more events pending. This message can be used 
to trigger reading events from the remote interface. 
Events should be read until the return status changes 
form OK__EVENT to OK. 



V. POWER-ON FLOW 
The microcontroller network 102 (Figure 1) performs various system 
administration tasks, such as, for example, monitoring the signals that come from 
server control switches, temperature sensors and client computers. By such signals, 
the microcontroller network 102, for example, tums on or turns off power to the 
server components, resets the server system, tums the system cooling fans to high, low 
or off, provides system operating parameters to the Basic Input/Output System (BIOS), 
transfers power-on self test (POST) events information from the BIOS, and/or sends 
data to a system display panel and remote computers. 

Microcontroller Communication 

A microcontroller, such as the remote interface microcontroller 200, handles 
two primary tasks: Sending and Receiving messages. 
1. Handling the requests from other microcontrollers: 

Incoming messages are handled based on interrupt, where a first byte of an 
incoming message is the Slave Address which is checked by all controllers 
connected to the microcontroller bus 1 60 (Figure 2) . Whichever 
microcontroller has the matched ID would respond with an acknowledgement 
to the sender controller. The sender then sends one byte of the message type 
followed by a two byte command ID, low byte first. The next byte of the 
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message defines the length of the data associated with the message. The first 
byte of the message also specifies whether it is a WRITE or READ command. 
If it is a WRITE command, the slave controller executes the command with the 
data provided in the message and sends back a status response at the end of the 
task. If it is a READ command, the slave controller gathers the requested 
information and sends it back as the response. The codes to execute request 
commands are classified in groups according to the data type to simplify the 
code, 

2. Sending a message to other microcontrollers: 

Messages can be initiated by any controller on the bus 160 (Figure 2), For 
example, the message can be an event detected by a controller and sent to the 
System Recorder controller and System Interface controller 106, or it could 
also be a message from the remote interface 104 (Figure 1) to a specific 
controller on the bus 160. The sender usually sends the first byte defining the 
target processor and waits for the acknowledgement, which is the reverse logic 
from the Receiving a Message sequence. The sender also generates the 
necessary clock for the communication. 

Referring to Figures 4a, 4b and Figure 1, a Power-On process 270 will now 
be described. Process 270 begins at start state 272 and if a connection between the 
client computer 122/124 and the server 100 is already active, process 270 proceeds to 
directly to state 296. Otherwise, if a connection is not ahready active, process 270 
proceeds to state 273 and utilizes the Recovery Manager software 130 to present a 
dialog window to the user on a display of the client computer 122/124 requesting 
information. The user is requested to enter a password for security purposes. The 
dialog window also has a pair of radio-buttons to select either a serial (local) 
connection or a modem (remote) connection. If serial is selected, the user is requested 
to select a COM port. If modem is selected, the user is requested to enter a telephone 
number to be used in dialing the server modem. 
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Moving to decision state 274, process 270 determines if a modem-type 
connection was selected. A modem-type connection is generally utilized in the 
situation where the client computer 124 is located at a location remote from the server 
100. If it is determined at decision state 274 that a modem connection is utilized, 
process 270 moves to state 276 wherein the cUent computer 124 is connected to the 
client modem 128. Moving to state 278, a connection is established between the client 
modem 128 and the server modem 126 via a communications network 127, as 
previously described above. Continuing at state 280, the server modem 126 connects 
with the remote interface 104. Proceeding to state 282, the remote interface 104 
connects to the server 100 via the RJ-45 cable 103. Moving to state 286, the 
Recovery Manager software 130 at the client computer 124 dials the server modem 
126 through the client modem 128, handshakes with the remote mterface 104, and 
checks the previously entered password. Process 270 remams at state 286 until a 
successful communication path v^th the remote interface 104 is established. 

Returning to decision state 274, if a local connection 121 is utilized instead of 
the modem connection 123, process 270 proceeds to state 288 wherein the local client 
computer 122 is connected with the remote interface 104. Moving to state 292, the 
remote interface 104 is connected with the server 100. The previously entered 
password (at state 273) is sent to the remote interface 104 to identify the user at the 
local computer 122. If the password matches a password that is stored in the server 
system 100, the communication path v^th the remote interface is enabled. 

After successful modem communication has been established and the password 
confirmed at state 286, or at the completion of connecting the remote interface to the 
server and checking the password at state 292, process 270 continues at state 296. At 
state 296, the Recovery Manager software 130 will in one embodiment display a 
recovery manager window 920, which includes a server icon 922 as shown in 
Figure 15. A server window panel 928 and a confirmation dialog box 936 are not 
displayed at this time. The user at the client computer 122/124 then selects the server 
icon on the display, such as, for example by clicking a pointer device on the icon. 
Moving to state 298, the server window panel 928 is then displayed to the user. The 
user confirmation box 936 is not displayed at this time. The user selects a Power On 
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button 930 on the window panel 928 to trigger the power-on operation. Continuing 
at state 300, the user confirmation dialog box 936 is then displayed on the client 
computer display. If the user confirms that the server is to be powered up, process 
270 proceeds through off page connector A 302 to state 304 on Figure 4b, 

At state 304, the Recovery Manager software 130 at the client computer 
122/124 provides a microcontroller network command (based on selecting the Power 
On button) and sends it to communication layer software. Proceeding to state 306, 
the communication layer puts a communications protocol around the command (from 
state 304) and sends the encapsulated command to the server through the client 
modem 128, the server modem 126 and the remote interface 104. The 
commimications protocol was discussed in conjunction with Figure 3 above. The 
encapsulated command is of the Request type 202 shown in Figure 3. The remote 
interface 104 converts the encapsulated command to the microcontroller network 

format, which is described in U.S. Patent Application No. , entitled 

"DIAGNOSTIC AND MANAGING DISTRIBUTED PROCESSOR SYSTEM," and 

in U.S. Patent Application No. , entitled "SYSTEM ARCHITECTURE 

FOR REMOTE ACCESS AND CONTROL OF ENVIRONMENTAL 
MANAGEMENT." Process 270 then continues to a function 310 wherein the server 
receives the command and powers on the server. Function 310 will be further 
described in conjunction with Figure 5, 

Moving to state 312, the response generated by the server is then sent to the 
remote interface 104. In one embodiment, the microcontroller (the Chassis controller 
170 in this instance) performing the command at the server returns status at the time 
of initiation of communication with the microcontroller. At the completion of the 
power-on operation by the Chassis controller 170, the Recovery Manager 130 sends 
a read status command to the Chassis controller (using states 304 and 306) to retrieve 
information on the results of the operation. 

Proceeding to decision state 314, process 270 determines if the power on 
command was successful. If so, process 270 proceeds to state 316 wherein the remote 
interface 104 sends the response to the server modem 126 indicating the success of 
the command. Alternatively, if a local connection 121 is utilized, the response is sent 
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to the local client computer 122. However, if the power on is not successful, as 
determined at decision state 314, process 270 proceeds to state 318 wherein the remote 
interface 104 sends the response to the server modem (or local client computer) 
indicatmg a failure of the command. At the conclusion of either state 316 or 318, 
process 270 proceeds to state 320 wherein the remote interface 104 sends the response 
back through the server modem 126 to the client modem 128. Moving to state 322, 
the client modem 128 sends the response back to the Recovery Manager software 130 
at the remote client computer 124. Note that if the local connection 121 is being 
utilized, states 320 and 322 are not necessary. Proceeding to decision state 324, 
process 270 determines whether the command was successful. If so, process 270 
continues at state 326 and displays a result window shoving the success of the 
command on the display at the client computer 122/124. However, if the command 
was not successful, process 270 proceeds to state 328 wherein a result window 
showing failure of the command is displayed to the user. Moving to state 330, the 
details of the command information are available, if the user so desires, by selecting 
a details button. At the completion of state 326 or state 330, process 270 completes 
at end state 332. 

Referring to Figure 5, one embodiment of the server Power On function 310 
will now be described. Beginning at start state 360, function 310 proceeds to state 
362 and logs the requested power-on to the server 100 in the System Recorder 
memory 112. Proceeding to decision state 364, function 310 determines if a system 
over-temperature condition is set. If so, function 310 proceeds to state 366 and sends 
a over-temperature message to the remote interface 104. Advancing to state 368, 
because the system over-temperature condition is set, the power-on process is stopped 
and function 310 returns at a retum state 370. 

Returning to decision state 364, if the system over-temperature condition is not 
set, function 310 proceeds to state 372 and sets an internal power-on indicator and a 
reset/run countdown timer. In one embodiment, the reset/run countdown timer is set 
to a value of five. Advancing to state 374, function 310 turns on the power and 
cooling fans for the server system board 150, backplane 152 and I/O canisters. The 
microcontroller network holds the main system processor reset/run control line in the 
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reset state until the reset/run countdown timer expires to allow the system power to 
stabilize* When the timer expires then the reset/run control is set to "run" and the 
system processor(s) begin their startup sequence by proceeding to state 376 and calling 
a BIOS Power-On Self Test (POST) routine. Moving to state 378, the BIOS 
5 initializes a PCI-ISA bridge and a microcontroller network driver. Continuing to state 
380, the microcontroller network software monitors: hardware temperatures, switches 
on a control panel on the server, and signals from the remote interface 104. In one 
embodiment, state 380 may be performed anywhere during states 376 to 394 because 
the BIOS operations are performed by the server CPUs 164 (Figure 2) independently 

10 of the microcontroller network 102, Function 310 then moves to a BIOS POST 
Coldstart function 386. In the Coldstart POST function, approximately 61 BIOS 
subroutines are called. The major groups of the Coldstart path include: CPU 
initialization, DMA/tuner reset, BIOS image check, chipset initialization, CPU register 
initialization, CMOS test, PCI initialization, extended memory check, cache enable, 

15 and message display. 

At the completion of the BIOS POST Coldstart function 386, function 310 
proceeds to state 388 where BIOS POST events are logged in the System Recorder 
memory 112. Proceeding to state 390, the BIOS POST performs server port 
initialization. Continuing at state 392, the BIOS POST initializes the Operating 

20 System related controllers (e.g., floppy controller, hard disk controller) and builds a 
multi-processor table. Advancing to state 394, the BIOS POST performs an OS boot 
preparation sequence. Function 310 ends at a retum state 398. 

VI. POWER-OFF FLOW 

25 Referring to Figures 6a, 6b and Figure 1, one embodiment of a Power-Off 

process 420 will now be described. Process 420 begins at start state 422 and if a 
connection between the client computer 122/124 and the server 100 is already active, 
process 420 proceeds to directly to state 446. Otherwise, if a connection is not 
already active, process 420 proceeds to state 423 and utilizes the Recovery Manager 

30 software 130 to present a dialog window to the user on a display of the client 
computer 122/124 requesting information. The user is requested to enter a password 
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for security purposes. The dialog window also has a pair of radio-buttons to select 
either a serial (local) connection or a modem (remote) connection. If serial is selected, 
the user is requested to select a COM port. If modem is selected, the user is requested 
to enter a telephone number to be used in dialing the server modem. 
5 Moving to decision state 424, process 420 determines if the modem-type 

connection 123 will be utilized. The modem-type connection is generally utilized in 
the situation where the client computer 124 is located at a location remote from the 
server 100. If it is determined at decision state 424 that a modem connection is 
utilized, process 420 moves to state 426 wherein the client computer 124 is connected 
10 to the client modem 128. Moving to state 428, a connection is established between 
the client modem 128 and the server modem 126 via the communications network 

127. Continuing at state 430, the server modem 126 connects with the remote 
interface 104. Proceeding to state 432, the remote interface 104 connects to the server 
100 via the RJ-45 cable 103. Moving to state 436, the Recovery Manager software 

15 130 at the client computer 124 dials the server modem 126 through the client modem 

128, handshakes with the remote interface 104, and checks the previously entered 
password. Process 420 remains at state 436 until a successful communication path 
with the remote interface 104 is established. 

Returning to decision state 424, if the local connection 121 is utilized instead 
20 of the modem connection 123, process 420 proceeds to state 438 wherein the local 

client computer 122 is connected with the remote interface 104. Moving to state 442, 
the remote interface 104 is connected with the server 100. The previously entered 
password (at state 423) is sent to the remote interface 104 to identify the user at the 
local computer 122. If the password matches the password that is stored in the server 
25 system 100, the communication path with the remote interface 104 is enabled. 

After successful modem communication has been established and the password 
confirmed at state 436, or at the completion of checking the password at state 442, 
process 420 continues at state 446. At state 446, the Recovery Manager software 130 
will in one embodiment display the Recovery Manager window 920, which includes 
30 the server icon 922 as shown in Figure 15. The server window panel 928 and the 
confirmation dialog box 936 are not displayed at this time. The user at the client 
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computer 122/124 then selects the server icon 922 on the display, such as by clicking 
the pointer device on the icon. Moving to state 448, the server window panel 928 
(Figure 15) is then displayed to the user. The user selects a Power Off button 932 on 
the window panel 928 to trigger the power-off operation. Continuing at state 450, a 
user confirmation dialog box is then displayed on the client computer display. If the 
user confirms that the server is to be powered down, process 420 proceeds through 
off page connector A 452 to state 454 on Figure 6b. 

At state 454, the Recovery Manager software 130 at the client computer 
122/124 provides a microcontroller network command (based on selecting the Power 
Off button) and sends it to communication layer software. Proceeding to state 456, 
the commxmication layer puts a communications protocol around the command (from 
state 454) and sends the encapsulated command to the server through the client 
modem 128, the server modem 126 and the remote interface 104. The encapsulated 
command is of the Request type 202 shown in Figure 3. Process 420 then continues 
to a fimction 460 wherein the server receives the command and powers off the server. 
Function 460 will be further described in conjunction with Figure 7. 

Moving to state 462, the response generated by the server is then sent to the 
remote interface 104. In one embodiment, the microcontroller (the Chassis controller 
170 in this instance) performing the command at the server returns status at the time 
of initiation of communication with the microcontroller. At the completion of the 
power-off operation by the Chassis controller 170, the Recovery Manager 130 sends 
a read status command to the Chassis controller (usmg states 454 and 456) to retrieve 
information on the results of the operation. 

Proceeding to decision state 464, process 420 determines if the power off 
command was successfiil. If so, process 420 proceeds to state 466 wherein the remote 
interface 104 sends the response to the server modem 126 indicating the success of 
the command. Alternatively, if a local connection 121 is utiUzed, the response is sent 
to the local client computer 122. However, if the power off is not successfiil, as 
determined at decision state 464, process 270 proceeds to state 468 wherein the remote 
interface 104 sends the response to the server modem (or local client computer) 
indicating a failure of the conunand. At the conclusion of either state 466 or 468, 
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process 420 proceeds to state 470 wherein the remote interface 104 sends the response 
back through the server modem 126 to the client modem 128. Moving to state 472, 
the client modem 128 sends the response back to the Recovery Manager software 130 
at the remote cUent computer 124. Note that if the local connection 121 is being 
5 utilized, states 470 and 472 are not necessary. Proceeding to decision state 474, 
process 420 determines whether the conmiand was successftil. If so, process 420 
continues at state 476 and displays a result window shoving the success of the 
conunand on the display at the client computer 122/124. However, if the conmiand 
was not successful, process 420 proceeds to state 478 wherein a result window 
10 showing failure of the command is displayed to the user. Moving to state 480, the 
details of the command information are available, if the user so desires, by selecting 
a details button. At the completion of state 476 or state 480, process 420 completes 
at end state 482. 

y Referring to Figure 7, the server Power-Off function 460 will now be 

^0 15 described. Begiiming at start state 500, function 460 proceeds to state 502 and logs 

|y the requested Power-Off message in the System Recorder memory 1 12 (Figure 2) by 

^ use of the System Recorder controller 110, Moving to state 504, function 460 clears 

1^ a system run indicator and clears the reset/run coimtdown timer. Moving to state 506, 

jy fimction 460 clears an internal pov^r-on indicator. In one embodiment, the power-on 

;2 20 indicator is stored by a variable "S4_power__on". Function 460 utilizes the CPU A 

U controller 166 for state 504 and the Chassis controller 170 for state 506. Continuing 

JfJ at state 508, function 460 turns off the power and the cooling fans for the system 

board 150, the backplane 152 and the canister(s) associated with the Canister 
controllers 172-178. Function 460 ends at a retum state 512. 

25 

VII. RESET FLOW 
Referring to Figxires 8a, 8b and Figure 1, one embodiment of a Reset process 
540 will now be described. Process 540 begins at start state 542 and if a connection 
between the client computer 122/124 and the server 100 is already active, process 540 
30 proceeds to directly to state 566. Otherwise, if a connection is not already active, 

process 540 proceeds to state 543 and utilizes the Recovery Manager software 130 to 
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present a dialog window to the user on a display of the client computer 122/124 
requesting information. The user is requested to enter a password for security 
purposes. The dialog window also has a pair of radio-buttons to select either a serial 
(local) connection or a modem (remote) connection. If serial is selected, the user is 
5 requested to select a COM port. If modem is selected, the user is requested to enter 
a telephone number to be used in dialing the server modem. 

Moving to decision state 544, process 540 determines if the modem-type 
connection 123 was selected. The modem-type connection is generally utilized in the 
situation where the client computer 124 is located at a location remote from the server 
10 100. If it is determined at decision state 544 that a modem connection is utilized, 
process 540 moves to state 546 wherein the client computer 124 is connected to the 
client modem 128. Moving to state 548, a connection is established between the client 
modem 128 and the server modem 126 via the commimications network 127. 
JS Continuing at state 550, the server modem 126 connects with the remote interface 104. 

15 Proceeding to state 552, the remote interface 104 connects to the server 100 via the 

ni RJ-45 cable 103. Moving to state 556, the Recovery Manager software 130 at the 

^ client computer 124 dials the server modem 126 through the client modem 128, 

1^ handshakes with the remote interface 104, and checks the previously entered 

|jL password. Process 540 remains at state 556 until a sxiccessful communication path 

2 20 with the remote interface 104 is established. 

1^ Returning to decision state 544, if the local connection 121 is utilized instead 

of the modem coimection 123, process 540 proceeds to state 558 wherein the local 
client computer 122 is connected with the remote interface 104. Moving to state 562, 
the remote interface 104 is connected vnth the server 100. The password previously 

25 entered (at state 543) is sent to the remote interface 104 to identify the user at the 
local computer 122. If the password matches the password that is stored in the server 
system 100, the communication path with the remote interface 104 is enabled. 

After successful modem communication has been established and the password 
confirmed at state 556, or at the completion of connecting the remote interface to the 

30 server and checking the password at state 562, process 540 continues at state 566. At 
state 566, the Recovery Manager software 130 will in one embodiment display the 
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Recovery Manager window 920, which includes the server icon 922 as shown in 
Figure 15, The server window panel 928 and the confirmation dialog box 936 are not 
displayed at this time. The user at the client computer 122/124 then selects the server 
icon 922 on the display, such as by clicking the pointer device on the icon. Moving 
5 to state 568, the server vdndow panel 928 (Figure 15) is then displayed to the user. 
The user confirmation box 936 is not displayed at this time. The user selects a 
System Reset button 934 on the window panel 928 to trigger the System Reset 
operation. Continuing at state 570, a user confirmation dialog box is then displayed 
on the client computer display. If the user confirms that the system is to be reset, 
10 process 540 proceeds through off page connector A 572 to decision state 574 on 
Figure 8b. 

At decision state 574, process 540 determines if the server is currently running 
(powered up, such as after a power on command has been issued). If not, process 540 
continues to state 576 wherein a warning message that the server must be running to 

15 execute a system reset is displayed on the client computer display to the user. After 

the warning has been displayed, process 540 moves to end state 578 to terminate the 
reset process. However, if the server is running, as determined at decision state 574, 
process 540 proceeds to state 580. 

At state 580, the Recovery Manager software 130 at the client computer 

20 122/124 provides a microcontroller network command (based on selecting the System 

Reset button) and sends it to the communication layer software. Proceeding to state 
582, the communication layer puts a communications protocol around the command 
(firom state 580) and sends the encapsulated command to the server through the client 
modem 128, the server modem 126 and the remote interface 104. The encapsulated 

25 command is of the Request type 202 shown in Figure 3. Process 540 then continues 
to a function 590 wherein the server receives the command and resets the server. 
Function 590 will be fiirther described in conjunction with Figure 9. 

Moving to state 592, the response generated by the server is then sent to the 
remote interface 104. In one embodiment, the microcontroller (the CPU A controller 

30 166 in this instance) performing the command at the server retums status at the time 

of initiation of communication with the microcontroller. At the completion of the 
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reset operation by the CPU A controller 166, the Recovery Manager 130 sends a read 
status command to the CPU A controller (using states 580 and 582) to retrieve 
information on the results of the operation. 

Proceeding to decision state 594, process 540 determines if the system reset 
command was successful. If so, process 540 proceeds to state 596 wherein the remote 
interface 104 sends the response to the server modem 126 indicating the success of 
the command. Alternatively, if a local connection 121 is utilized, the response is sent 
to the local client computer 122, However, if the system reset is not successful, as 
determined at decision state 594, process 540 proceeds to state 598 wherein the remote 
interface 104 sends the response to the server modem (or local client computer) 
indicating a failure of the command. At the conclusion of either state 596 or 598, 
process 540 proceeds to state 600 wherein the remote interface 104 sends the response 
back through the server modem 126 to the client modem 128. Moving to state 602, 
the client modem 128 sends the response back to the Recovery Manager software 130 
at the remote client computer 124. Note that if the local connection 121 is being 
utilized, states 600 and 602 are not necessary. Proceeding to decision state 604, 
process 540 determines whether the command was successful. If so, process 540 
continues at state 606 and displays a result window showing the success of the 
command on the display at the client computer 122/124. However, if the command 
was not successful, process 540 proceeds to state 608 wherein a result window 
shoving failure of the command is displayed to the user. Moving to state 610, the 
details of the conmiand information are available, if the user so desires, by selecting 
a details button. At the completion of state 606 or state 610, process 540 completes 
at end state 612. 

Referring to Figure 9, the server reset function 590 will now be described. 
Beginning at start state 630, function 590 proceeds to the BIOS POST Warmstart 
function 384. In the Warmstart function 384, approximately 41 subroutines are called. 
These include the general operations of: reset flag, DMA/timer reset, chipset 
initialization, CMOS test, PCI initialization, cache enable, and message display. At 
the completion of the BIOS POST Warmstart function 384, function 590 proceeds to 
state 388 where BIOS POST events are logged in the System Recorder memory 112. 
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Proceeding to state 390, the BIOS POST performs server port initialization. 
Continuing at state 392, the BIOS POST initializes the Operating System related 
controllers (e.g., floppy disk controller, hard disk controller) and builds a multi- 
processor table. Advancing to state 394, the BIOS POST performs an OS boot 
preparation sequence. Moving to state 632, the BIOS initiates an OS boot sequence 
to bring the operating software to an operational state. Function 590 ends at a return 
state 636. 

VIIL FLIGHT RECORDER FLOW 

A Flight Recorder, which includes the System Recorder controller 110 and the 
System Recorder memory 112, provides a subsystem for recording a time-stamped 
history of events leading up to a failure in server system 100. The System Recorder 
memory 112 may also store identification of components of the server system. In one 
embodiment, the System Recorder 110 is the only controller which does not initiate 
messages to other controllers. The System Recorder 110 receives event log 
information from other controllers and stores the data into the System Recorder 
memory 112. Upon request, the System Recorder 110 can send a portion and/or the 
entire logged data to a requesting controller. The System Recorder 110 puts a time 
stamp from a real-time clock with the data that is saved. 

Referring to Figures 10a, 10b and Figure 1, one embodiment of a Display 
Flight Recorder process 670 will now be described. Process 670 begins at start state 
672 and if a connection between the client computer 122/124 and the server 100 is 
already active, process 670 proceeds to directly to state 696. Otherwise, if a 
connection is not already active, process 670 proceeds to state 673 and utilizes the 
Recovery Manager software 130 to present a dialog window to the user on a display 
of the client computer 122/124 requesting information. The user is requested to enter 
a password for security purposes. The dialog window also has a pair of radio-buttons 
to select either a serial (local) connection or a modem (remote) connection. If serial 
is selected, the user is requested to select a COM port. If modem is selected, the user 
is requested to enter a telephone number to be used in dialing the server modem. 
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Moving to decision state 674, process 670 determines if the modem-type 
connection 123 was selected. The modem-type connection is generally utilized in the 
situation where the client computer 124 is located at a location remote from the server 
100. If it is determined at decision state 674 that a modem connection is utilized, 
process 670 moves to state 676 wherein the client computer 124 is connected to the 
client modem 128. Moving to state 678, a connection is established between the client 
modem 128 and the server modem 126 via the communications network 127. 
Continuing at state 680, the server modem 126 connects with the remote interface 104. 
Proceeding to state 682, the remote interface 104 connects to the server 100 via the 
RJ-45 cable 103. Moving to state 686, the Recovery Manager software 130 at the 
client computer 124 dials the server modem 126 through the client modem 128, 
handshakes with the remote interface 104, and checks the previously entered 
password. Process 670 remains at state 686 imtil a successful commimication path 
with the remote interface 104 is established. 

Returning to decision state 674, if the local connection 121 is utilized instead 
of the modem connection 123, process 670 proceeds to state 688 wherein the local 
client computer 122 is connected with the remote interface 104, Moving to state 692, 
the remote interface 104 is connected with the server 100. The previously entered 
password (at state 673) is sent to the remote interface 104 to identify the user at the 
local computer 122. If the password matches the password that is stored in the server 
system 100, the commimication path with the remote interface 104 is enabled. 

After successful modem communication has been established and the password 
confirmed at state 686, or at the completion of connecting the remote interface to the 
server and checking the password at state 692, process 670 continues at state 696. At 
state 696, the Recovery Manager software 130 will in one embodiment display a 
Recovery Manager window 940, which includes a Flight Recorder icon 942 as shown 
in Figure 16. A Flight Recorder window panel 944 is not displayed at this time. The 
user at the client computer 122/124 then selects the Flight Recorder icon 942 on the 
display, such as by clicking the pointer device on the icon. Moving to state 698, the 
Flight Recorder window panel 944 (Figure 16) is then displayed to the user. The user 
selects a Download button 954 on the window panel 944 to trigger the display of the 
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Flight Recorder operation. Note that other options in the Flight Recorder window 
panel 944 include a Save button 956 for saving a downloaded Flight Recorder (system 
log or System Recorder memory 1 12, Figure 1) and a Print button 958 for printing the 
downloaded Flight Recorder. Continuing at state 700, a user confirmation dialog box 
(not shown) is then displayed on the client computer display showing a number of 
messages in the server system log. Moving to state 702, if the user selects the "OK" 
button, process 670 displays a progress window of downloaded messages. Process 670 
proceeds through off page connector A 703 to state 704 on Figure 10b. 

At state 704, the Recovery Manager software 130 at the client computer 
122/124 provides a microcontroller network command (based on selecting the 
Download Flight Recorder button 954) and sends it to the communication layer 
software. Proceeding to state 706, the communication layer puts a communications 
protocol aroxmd the command (fi-om state 704) and sends the encapsulated command 
to the server through the client modem 128, the server modem 126 and the remote 
interface 104. The encapsulated command is of the Request type 202 shown in Figure 
3. Process 670 then continues to a fimction 710 wherein the server receives the 
command and reads the contents of the System Recorder memory 112 (Figure 1). In 
one embodiment, each read request generates one response such that the Recovery 
Manager 130 generates multiple read requests to read the complete system log. The 
server generates one log response during fimction 710. Function 710 will be fiirther 
described in conjunction with Figure 11. 

Moving to state 712, each of the responses generated by the server are then 
sent one at a time to the remote interface 104. Process 670 then proceeds to state 714 
wherein the remote interface 104 sends each response back through the server modem 
126 to the client modem 128. Alternatively, if a local connection 121 is utilized, each 
response is sent directly to the local client computer 122. Moving to state 716, the 
client modem 128 sends the response back to the Recovery Manager software 130 at 
the remote client computer 124. Note that if the local connection 121 is being 
utilized, state 716 is not necessary. Proceeding to decision state 718, process 670 
determines whether the entire download of the Flight Recorder was successfiil by 
checking for an end of system log messages status. If so, process 670 continues at 
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state 720 wherein the Recovery Manager 130 (Figure 1) displays (and optionally 
stores) all messages in the Flight Recorder window panel 944 on the display at the 
client computer 122/124. However, if the entire download was not successful, process 
670 proceeds to state 722 wherein the Recovery Manager 130 displays (and optionally 
stores) all messages that were received by the Recovery Manager 120 in the Flight 
Recorder window panel 944. At the completion of state 720 or state 722, process 670 
completes at end state 724. 

In one embodiment, the Flight Recorder window panel 944 includes four fields: 
Time Stamp 946, Severity 948, Message Source 950, and Message 952. Each 
message in the system log 112 includes a time stamp 946 of when the item was 
written to the log 112. The time stamp includes the date and the local time zone of 
the client computer 122/124 running the Recovery Manager 130, In one embodiment, 
the time stamp information is generated by a timer chip 760 (Figure 12a). The 
Severity field 948 includes a severity value selected from: unknown, informational, 
warning, error, and severe/fatal. The Message Source field 950 includes a source 
selected fi*om: microcontroller network internal, onboard diagnostics, external 
diagnostics, BIOS, time synchronizer, Windows®, WindowsNT®, NetWare, OS/2, 
UNIX, and VAX/VMS. The messages in the Message field 952 correspond to the 
data returned by the controllers on the microcontroller network 102. The controller „ 
message data is used to access a set of Message tables associated with the Recovery 
Manager 130 on the client computer 122/124 to generate the information displayed in 
the Message field 952. The Message tables include a microcontroller network (wire 
services) table, a BIOS table and a diagnostics table. An exemplary message from the 
microcontroller network table includes "temperature sensor #5 exceeds warning 
threshold". An exemplary message from the BIOS table includes "check video 
configuration against CMOS". An exemplary message from the diagnostics table 
includes "correctable memory error". 

Referring to Figure 11, the Read NVRAM Contents function 710 v^U now be 
described. Beginning at start state 740, function 710 proceeds to state 742 and loads 
a block log pointer. The System Recorder memory or NVRAM 112 (Figure 2) has 
two 64K byte memory blocks. The first block is a memory block which stores ID 
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codes of the devices installed in the network. Hence, a command addressed to the 
first block is typically generated by a controller responsible for updating the presence 
or absence of devices in the network. The second block of the memory 112 is a 
memory block that stores event messages in connection v^th events occurring in the 
network. Hence, controllers addressing the second block do so to add entries to the 
system log or to read previous entries contained in the system log. The System 
Recorder uses log address pointers to determine where the next new entry in the log 
should be placed and also to determine where the log is currently being read firom. 
A further description of the System Recorder 110 and the NVRAM 112 is provided 

in U.S. Patent Application No. , entitled, "BLACK BOX 

RECORDER FOR INFORMATION SYSTEM EVENTS". 

Moving to state 744, function 710 reads the log message as addressed by the 
log pointer. Proceeding to state 746, function 710 returns the log message to the 
requestor on the microcontroller bus 160 (Figure 2), which is the remote interface 
controller 200 in this situation. In one embodiment, the remote interface 104 stores 
the message in a memory 762 (Figiire 12c) on the RIB. Proceeding to state 748, 
process 710 increments the log pointer to point to the next address in the NVRAM 
block. Continuing at decision state 750, function 710 determines if the end of the 
messages in the System Recorder memory block has been reached. If not, function 
710 proceeds to a normal retum state 752. If the end of the messages has been 
reached, as determined at decision state 750, function 710 moves to a retum state 754 
and returns a End of Messages status. The Recovery Manager 130 utilizes this status 
information to stop sending requests to read the System Recorder memory 112. 

IX. SYSTEM STATUS FLOW 
Figures 12a, 12b and 12c are a detailed block diagram of the microcontroller 
network components showing specific inputs and outputs of the microcontrollers. An 
I/O Canister card 758 has fan speed detection circuitry 765 to provide fan speed 
information to the Canister controller 172 through a fan multiplexer 767. The CPU 
A controller 166 receives fan speed information from fan speed detection circuitry 764 
through a fan multiplexer 765. 



-37- 



Referring to Figures 13a, 13b and Figure 1, one embodiment of a System 
Status process 770 will now be described. Process 770 begins at start state 772 and 
if a connection between the client computer 122/124 and the server 100 is already 
active, process 770 proceeds to directly to state 796. Otherwise, if a connection is not 
already active, process 770 proceeds to state 773 and utilizes the Recovery Manager 
software 130 to present a dialog window to the user on a display of the client 
computer 122/124 requesting information. The user is requested to enter a password 
for security purposes. The dialog window also has a pair of radio-buttons to select 
either a serial (local) connection or a modem (remote) connection. If serial is selected, 
the user is requested to select a COM port. If modem is selected, the user is requested 
to enter a telephone number to be used in dialing the server modem. 

Moving to decision state 774, process 770 determines if the modem-type 
connection 123 was selected. The modem-type connection is generally utilized in the 
situation where the client computer 124 is located at a location remote from the server 
100, If it is determined at decision state 774 that a modem connection is utilized, 
process 770 moves to state 776 wherein the client computer 124 is connected to the 
client modem 128. Moving to state 778, a connection is established between the client 
modem 128 and the server modem 126 via the communications network 127. 
Continuing at state 780, the server modem 126 connects with the remote interface 104. 
Proceeding to state 782, the remote interface 104 connects to the server 100 via the 
RJ-45 cable 103. Moving to state 786, the Recovery Manager software 130 at the 
client computer 124 dials the server modem 126 through the client modem 128, 
handshakes with the remote interface 104, and checks the previously entered 
password. Process 770 remains at state 786 imtil a successfiil conmiunication path 
with the remote interface 104 is established. 

Returning to decision state 774, if the local connection 121 is utilized instead 
of the modem connection 123, process 770 proceeds to state 788 wherein the local 
client computer 122 is connected with the remote interface 104. Moving to state 792, 
the remote interface 104 is connected v^th the server 100. The previously entered 
password (at state 773) is sent to the remote interface 104 to identify the user at the 
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local computer 122. If the password matches the password that is stored in the server 
system 100, the communication path with the remote interface 104 is enabled. 

After successful modem communication has been established and the password 
confirmed at state 786, or at the completion of connecting the remote interface to the 
server and checking the password at state 792, process 770 continues at state 796. At 
state 796, the Recovery Manager software 130 will in one embodiment display a 
Recovery Manager v^ndow 960, which includes a System Status icon 970 as shown 
in Figure 17. A System Status window panel 962 is not displayed at this time. The 
user at the client computer 122/124 then selects the System Status icon 970 on the 
display, such as by clicking the pointer device on the icon. Moving to state 798, the 
System Status Mdndow panel 962 (Figure 17) is then displayed to the user. The user 
selects one of a multiple set of component icons 972-984 on the window panel 962 
to initiate a System Status operation. In one embodiment, icon 972 is for Power 
Supplies, icon 974 is for Temperatures, icon 976 is for Fans, icon 978 is for 
Processor, icon 980 is for I/O Canisters, icon 982 is for Serial Numbers and icon 984 
is for Revisions. When the user selects one of the icons 972-984, the Recovery 
Manager 130 displays a component v^ndow panel to the user, such as exemplary Fans 
window panel 994 (Figure 18) if the user selected the Fans icon 976, 

In one embodiment, the exemplary Fans window panel 994 (Figure 18) 
includes several fields 985-991: field 985 is for Fan Location, field 986 is for Fan 
Number within the Location, field 987 is for Fan Speed (rpm, as detected by the 
microcontrollers 166 and 172 (Figure 12)), field 988 is for Fan Speed Control (high 
or low), field 989 is for Fault Indicator LED (on or off), field 990 is for Fan Fault 
(yes or no), and field 991 is for Fan Low-speed Fauh Threshold Speed (rpm). Note 
that this exemplary Fans vraidow panel 994 includes a Refi-esh button 992 which 
triggers a retrieval of new values for the fields of the panel. 

If the user selects a Canister A icon 1000 in the Recovery Manager window 
panel 960, the Recovery Manager 130 displays an exemplary Fans detail window 
panel 1002 (Figure 19). This exemplary panel 1002 provides status information for 
the fans of the selected Canister A, which in this embodiment includes a status box 
1004 for a Fan 1 and a status box 1006 for Fan 2 along with a Canister Present 
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indicator 1008 and a Fault Indicator Led box 1010. These status items 1004-1010 are 
refreshed (new status information is retrieved) if the user selects a Refresh button 
1012. A Fan Low-speed Fault Threshold Speed entry box 1020 and a Fan Speed 
Control radio button box 1022 allow the user to enter new values if it desired to 
change the current settings. An Update operation to change the values of the settings 
is initiated if the user selects the Update button 1024. 

Continuing in Figure 13a at decision state 799, process 770 determines if the 
Refresh Status operation is to be performed, if for example, the user selected a 
Refresh button on one of the System status windows. If so, process 770 proceeds to 
state 800 and initiates the Refresh operation to retrieve new status information for 
display to the user. If the Refresh operation is not selected, as determined at decision 
state 799, process 770 advances to decision state 801 to determine if the Update 
operation is to be performed, if for example, the user selected a Update button on one 
of the System status windows. If so, process 770 proceeds to state 802 and initiates 
the Update operation to update item settings that the user desires to change. At the 
completion of either state 800 or state 802, or if the user selects another status option 
(e.g.. Help), process 670 proceeds through off page connector A 803 to state 804 on 
Figure 13b. 

At state 804, the Recovery Manager software 130 at the client computer 
122/124 provides a microcontroller network command (based on selecting one of 
System Status operations (e.g.. Update, Refresh)) and sends it to the communication 
layer software. Proceeding to state 806, the communication layer puts a 
communications protocol around the command (from state 804) and sends the 
encapsulated command to the server through the client modem 128, the server modem 
126 and the remote interface 104. The encapsulated command is of the Request type 
202 shown in Figure 3. Process 770 then continues to a fimction 810 wherein the 
server receives the command and retrieves or updates the selected status information 
for the selected item(s), e.g.. Fans. In one embodiment, for example, each Refresh 
request generates one response such that the Recovery Manager 130 generates multiple 
Refresh requests to retrieve the complete set of status information. Function 810 will 
be fiirther described in conjimction with Figure 14. 
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Moving to state 812, each of the responses generated by the server are then 
sent one at a time to the remote interface 104. Process 770 then proceeds to state 814 
wherein the remote interface 104 sends each response back through the server modem 
126 to the client modem 128. Alternatively, if a local connection 121 is utilized, each 
response is sent directly to the local client computer 122, Moving to state 822, the 
client modem 128 sends the response back to the Recovery Manager software 130 at 
the remote client computer 124. Proceeding to decision state 824, process 770 
determines whether the executed command was a Retrieve (Refresh) or Update 
command. If the command was a Retrieve, process 770 moves to decision state 826 
to determine if the Retrieve operation was successful. If so, process 770 continues to 
state 828 wherein the Recovery Manager 130 (Figure 1) displays the new system 
status information in a System Status window panel (such as window panel 994 
(Figure 18) or window panel 1002 (Figure 19)) on the display at the client computer 
122/124. However, if the Refresh operation was not successful, process 770 proceeds 
to state 830 wherein the Recovery Manager 130 shows new status information for the 
items that the new status information has been successfully received (if any). 

Returning to decision state 824, if the command was an Update, process 770 
moves to decision state 834 to determine if the Update operation was successful If 
so, process 770 continues to state 836 wherein the Recovery Manager 130 (Figure 1) 
displays an Update Successful indication in the appropriate Status window. However, 
if the Update operation was not successful, process 770 proceeds to state 838 wherein 
the Recovery Manager 130 displays an Update Failure indication in the appropriate 
Status window. Moving to state 840, the details of the conmiand information are 
available, if the user so desires, by selecting a Details button (not shown). At the 
completion of any of states 828, 830, 836 or 840, process 770 completes at end state 
842. 

Referring to Figure 14, the Server System Status function 810 will now be 
described. Beginning at start state 870, function 810 proceeds to state 872 wherein 
each microcontroller on the microcontroller network bus 160 (Figure 2) checks to see 
if the address field of the system coromand received from the recovery manager 130 
(Figure 1) at the client computer matches that of the microcontroller. Continuing at 
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state 874, the addressed microcontroller executes a command, e.g., retrieve data or 
update data. Continuing at state 876 the addressed microcontroller sends a response 
message back on the microcontroller bus 160 to the controller that initiated the 
conmiand, which is the remote interface controller 200 (Figure 2) in this situation. 
Moving to decision state 878, function 810 determines whether additional items are 
selected for retrieval or update. If so, function 810 moves to state 880 to access the 
next command and then moves back to state 872 wherein each microcontroller again 
checks to see if it is addressed. The single addressed microcontroller performs states 
872, 874 and 876, If there are no more items selected for retrieval or update, as 
determined at decision state 878, function 810 proceeds to a return state 882 where 
function 810 completes. 

States 878, 880 and 882 are performed by the Recovery Manager 130 at the 
client computer 122/124. For example, if the user wanted system status on all the fans 
by selecting the Fan icon 976 (Figure 18), the Recovery Manager 130 generates one 
command for each of a selected group of microcontrollers for retrieving fan 
information. Thus, a command to read fan information from CPU A controller 166 
(Figure 2) is sent out and a response received, followed by a command to and 
response from Canister A controller 172, and so on through Canister B controller 174, 
Canister C controller 176 and Canister D controller 178. 

In one embodiment, the System Status windows provide the following status 
information: 

System Status: Power Supplies 

This vdndow displays power supply status information. To obtain current information, 
click Refresh. This information includes: 

Present: Indicates the power supply is installed and present 

A.C.: Indicates whether the power supply is receiving A.C. power. 

D.C.: Indicates whether the power supply is supplying D.C. voltage. 

Power: Indicates the server is On or Off. 
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Output Voltages: Indicates the power (in volts) generated by each power supply 
line. 



System Status: Temperature 

This window displays information about the operational temperatures of the server. 
To obtain current temperature information, click Refresh. To apply any changes made 
in this window, click Update. 



Temperature Sensor 1: 
Temperature Sensor 2: 
Temperature Sensor 3: 
Temperature Sensor 4: 
Temperature Sensor 5: 
Warning Level: 



Shutdown Level: 



Show Temp in Degrees: 



System Overtemp?: 



Indicates the temperature measured by Sensor 1. 
Indicates the temperature measured by Sensor 2. 
Indicates the temperature measured by Sensor 3. 
Indicates the temperature measured by Sensor 4. 
Indicates the temperature measured by Sensor 5. 
Shows the temperature warning level (in one 
embodiment, the default is 55 degrees Celsius), When 
any temperature sensor measures this level or higher, a 
warning is issued. To change the warning level, enter a 
new temperature and click Update. 
Shows the temperature shutdown level (in one 
embodiment, the default is 70 degrees Celsius). When 
any temperature sensor measures this level or higher, the 
server is automatically shut down. To change the 
shutdown level, enter a new temperature and click 
Update. 

Select whether the temperatures are in Celsius or 
Fahrenheit. 

Indicates whether the server temperature is above the 
Warning threshold. 
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System Status: Fans 

This window displays server and group fan status information. To obtain current 
status information, click Refresh. The information that appears in this window 
includes: 



Location: 

Fans 1-6 (System Board), 1-2 (Group): 
Speed: 

Speed Control: 
Fault Indicator LED: 
Fault: 

Low-speed Fault Threshold Speed: 



Indicates the location of the fan. Options 
include System Board and Groups A or B. 
Indicates the location of the fan. For 
information on the physical location, click 
here Location icon. 

Displays the fan operating speed (in 
RPM). 

Indicates the fan is operating at High or 
Low speed. 

Indicates the Fan Fault LED on the server 
enclosure is On or Off 
Indicates whether the fan failed. 
Displays the low-speed fault threshold 
speed. When a fan drops below this 
speed, the fan is reported as failed. To 
change failure level, enter a new speed (in 
RPM) and click Update. In one 
embodiment, the speed is entered in 
increments of 60 (e.g., 60, 120, 180, etc.). 



Note: To view status information on a specific group of fans, change their speed, or 
modify the speed at which they are considered failed, double-click the fan group's 
icon. 
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System Board Fans 

This window displays information about the status of the system board fans. To 
obtain current information, click Refresh. To apply any changes made in this window, 
click Update. 

Group X Fans 

This window displays information about the status of the fans in the selected group. 
To obtain current information, click Refresh. To apply any changes made in this 
window, click Update. 

Canister X Fans 

This window displays information about the status of the fans in the selected canister. 
To obtain current information, click Refresh. To apply any changes made in this 
window, click Update. 

System Status: Processor 

This window displays processor status information. To obtain current information, 

click Refresh, This information includes: 

CPU 1-4: Indicates the location of the CPU. 

Present: Indicates whether the CPU is installed. 

Power: Indicates whether the system is receiving power. 

Overtemp: Indicates whether the system is running above operating 



Error: 



temperature. 

Indicates whether a CPU internal error occurred. 



NMI Control: 



Indicates whether NMI control is active or inactive. 
Indicates whether faults or errors occurred on any 
installed processors. 

Indicates the server's Bus/Core speed ratio, a relative 
indicator of processor performance. 



Any Fault?: 



Bus/Core Speed Ratio: 
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CPU X status: 

This window displays status information for the selected CPU. To obtain current 
information, click Refresh. To apply any changes made in this window, click Update. 



Present: When selected, the CPU is installed. 

Power: Indicates whether the system is receiving power. 

Overtemp: Indicates whether the system is running above operating 

temperature. 

Error: Indicates whether a CPU internal error occurred. 

NMI Control: Indicates NMI control is active or inactive. 

System Status: I/O Groups 

This window displays I/O group status information. To obtain current information, 
click Refresh. This information includes: 



PCI 1-4: 



PCI Power: 



Indicates whether a peripheral card is installed in the specified 
PCI slot. 

Indicates whether the canister's PCI bus is receiving power. 



System Status: I/O Canisters 

This wmdow displays I/O canister status information. To obtain current information, 
click Refresh. This information includes: 



Status: Indicates the canister is inserted or removed, 

PCI 1-4: Indicates whether a peripheral card is installed in the specified 

PCI slot. 

PCI Power: Indicates whether the canister's PCI bus is receiving power. 



System Status: Serial Numbers 

This window lists the serial numbers of the system board, backplane, canisters, power 
suppUes, and remote interface. To obtain current information, click Refresh. 
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System Status: Revisions 

This window displays server component revision information for the backplane, 
system board, power supplies, I/O canisters or I/O groups, system interface and remote 
interface. To obtain current information, click Refresh, 

While the above detailed description has shown, described, and pointed out the 
fundamental novel features of the invention as applied to various embodiments, it will 
be understood that various omissions and substitutions and changes in the form and 
details of the system illustrated may be made by those skilled in the art, without 
departing from the intent of the invention. 
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WHAT IS CLAIMED IS : 

1. A method of retrieving or updating system status for a computer, the method 
comprising the acts of: 

sending a command for remotely retrieving or updating system status 
from a second computer through a remote interface to a first computer; 

executing the command on a microcontroller in the first computer; and 
sending a retrieve or update system status signal from the 
microcontroller to the first computer thereby retrieving or updating the system 
status. 

2. The method of Claim 1, additionally including the act of providing power to 
the remote interface from a remote interface power supply independent of a first 
computer power supply. 

3. The method of Claim 1, wherein the second computer is at the same location 
as the first computer. 

4. The method of Claim 1, wherein the second computer is at a location remote 
to the first computer. 

5* The method of Claim 4, wherein the act of sending the remotely retrieving or 
updating system status command from the second computer includes the act of 
connecting a pair of modems, wherein a first modem connects to the first computer 
and a second modem connects to the second computer. 

6. The method of Claim 1, fiirther including the act of providing a response to the 
second computer through the remote interface based on results of the command. 

7. A method of retrieving or updating system status for a computer, the method 
comprising the acts of: 
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connecting a remote interface to a first computer and a second 
computer; 

providing a retrieving or updating system status command at the second 
computer directed to the first computer; 

encapsulating the command in a communications protocol; 

transmitting the encapsulated command to the remote interface; 

communicating the command received by the remote interface to the 
first computer; and 

performing the command on the first computer. 

8. The method of Claim 1, wherein the act of performing the command includes 
the act of establishing a secure mode in the computer environment. 

9. The method of Claim 7, wherein the act of performing the command includes 
the act of sending data to a component of the first computer. 

10. The method of Claim 7, wherein the act of performing the command includes 
the act of requesting data fi:om a component of the first computer, 

11. The method of Claim 7, wherein the act of communicating the command 
includes the act of storing command data in a memory associated with the remote 
interface. 

12. The method of Claim 7, fiirther including the act of providing a response to the 
second computer through the remote interface based on results of the command. 

13. The method of Claim 12, wherein the act of providing a response includes the 
act of storing response data in a memory associated with the remote interface. 

14. A method of external management of a computer environment, the method 
comprising the acts of: 
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providing a first computer; 
providing a second computer; 

selecting, at the second computer, a component of the first computer to 
be managed; 

selecting, at the second computer, a management operation to be 
performed by the first computer on the selected component; 

communicating the selected component and selected operation from the 
second computer to the first computer; and 

performing the selected operation on the selected component at the first 
computer. 



15. The method of Claim 14, further including the act of providing a response to 
the second computer based on the results of the selected operation. 

16. The method of Claim 15, further including the act of displaying the response 
to a user at the second computer. 
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METHOD OF DISPLAYING SYSTEM STATUS 



Abstract of the Disclosure 
A fault tolerant method of obtaining and displaying, or updating the status of 
server components through a Remote Interface Board and either a local or remote 
client machine without intervention of the server operating system software. The 
remote machine accesses the server by use of a dial-in modem connection, while the 
local machine accesses the server by a local serial cormection. The components that 
can be monitored include, but are not limited to, the foUov^ng: Power Supplies, 
Temperatures, Fans, Processors, I/O Groups, I/O Canisters, Serial Numbers, and 
Revisions. 



RJS-3384:sad 
093097 
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A ppendix A 

Incorporation by Reference of Commonly Owned Applications 

The following patent applications, commonly owned and filed on the same day 
as the present application are hereby incorporated herein in their entirety by reference 
thereto: 



Title 

"System Architecture for Remote 
Access and Control of Environmental 
Management" 

"Method of Remote Access and 
Control of Environmental 
Management" 

"System for Independent Powering of 
Diagnostic Processes on a Computer 
System" 

"Method of Independent Powering of 
Diagnostic Processes on a Computer 
System" 

"Diagnostic and Managing Distributed 
Processor System" 

"Method for Managing a Distributed 
Processor System" 

"System for Mapping Environmental 
Resources to Memory for Program 
Access" 

"Method for Mapping Environmental 
Resources to Memory for Program 
Access" 

"Hot Add of Devices Software 
Architecture" 

"Method for The Hot Add of Devices" 

"Hot Swap of Devices Software 
Architecture" 

"Method for The Hot Swap of 
Devices" 



Application No. Attorney Docket 

No. 

MNFRAME.002A1 



MNFRAME,002A2 

MNFRAME,002A3 

MNFRAME.002A4 

MNFRAME.005A1 
MNFRAME,005A2 
MNFRAME.005A3 

MNFRAME.005A4 

MNFRAME.006A1 

MNFRAME,006A2 
MNFRAME.006A3 

MNFRAME.006A4 
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Title 

"Method for the Hot Add of a Network 
Adapter on a System Including a 
Dynamically Loaded Adapter Driver" 

"Method for the Hot Add of a Mass 
Storage Adapter on a System Including 
a Statically Loaded Adapter Driver" 

"Method for the Hot Add of a Network 
Adapter on a System Including a 
Statically Loaded Adapter Driver" 

"Method for the Hot Add of a Mass 
Storage Adapter on a System Including 
a Dynamically Loaded Adapter Driver" 

"Method for the Hot Swap of a 
Network Adapter on a System 
Including a Dynamically Loaded 
Adapter Driver" 

"Method for the Hot Swap of a Mass 
Storage Adapter on a System Including 
a Statically Loaded Adapter Driver" 

"Method for the Hot Swap of a 
Network Adapter on a System 
Including a Statically Loaded Adapter 
Driver" 

"Method for the Hot Swap of a Mass 
Storage Adapter on a System Including 
a Dynamically Loaded Adapter Driver" 

"Method of Performing an Extensive 
Diagnostic Test in Conjunction with a 
BIOS Test Routine" 

"Apparatus for Performing an 
Extensive Diagnostic Test in 
Conjunction with a BIOS Test 
Routine" 

"Configuration Management Method 
for Hot Adding and Hot Replacing 
Devices" 



Application No. Attorney Docket 

No. 

MNFRAME.006A5 



MNFRAME.006A6 



MNFRAME.006A7 



MNFRAME.006A8 



MNFRAME.006A9 



MNFRAME.006A10 



MNFRAME.006A11 



MNFRAME,006A12 



MNFRAME.008A 



MNFRAME.009A 



MNFRAME.OlOA 
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Title 

"Configuration Management System 
for Hot Adding and Hot Replacing 
Devices'* 

"Apparatus for Interfacing Buses" 

"Method for Interfacing Buses" 

"Computer Fan Speed Control Device" 

"Computer Fan Speed Control Method" 

"System for Powering Up and 
Powering Down a Server" 

"Method of Powering Up and 
Powering Down a Server" 

"System for Resetting a Server" 

"Method of Resetting a Server" 

"System for Displaying Flight 
Recorder" 

"Method of Displaying Flight 
Recorder" 

"Synchronous Communication 
Interface" 

"Synchronous Communication 
Emulation" 

"Software System Facilitating the 
Replacement or Insertion of Devices in 
a Computer System" 

"Method for Facilitating the 
Replacement or Insertion of Devices in 
a Computer System" 

"System Management Graphical User 
Interface" 

"Display of System Information" 

"Data Management System Supporting 
Hot Plug Operations on a Computer" 



Application No. 



Attorney Docket 
No. 

MNFRAME.OllA 



MNFRAME.012A 
MNFRAME.013A 
MNFRAME.016A 
MNFRAME^017A 
MNFRAME.018A 

MNFRAME.019A 

MNFRAME.020A 
MNFRAME.021A 
MNFRAME.022A 

MNFRAME.023A 

MNFRAME.024A 

MNFRAME,025A 

MNFRAME.026A 

MNFRAME.027A 

MNFRAME.028A 

MNFRAME.029A 
MNFRAME,030A 
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Title 

"Data Management Method Supporting 
Hot Plug Operations on a Computer" 

"Alert Configurator and Manager" 

"Managing Computer System Alerts" 

"Computer Fan Speed Control System" 

"Computer Fan Speed Control System 
Method" 

"Black Box Recorder for Information 
System Events" 

"Method of Recording Information 
System Events" 

"Method for Automatically Reporting a 
System Failure in a Server" 

"System for Automatically Reporting a 
System Failure in a Server" 

"Expansion of PCI Bus Loading 
Capacity" 

"Method for Expanding PCI Bus 
Loading Capacity" 

"System for Displaying System Status" 

"Method of Displaying System Status" 

"Fault Tolerant Computer System" 

"Method for Hot Swapping of Network 
Components" 

"A Method for Communicating a 
Software Generated Pulse Waveform 
Between Two Servers in a Network" 

"A System for Communicating a 
Software Generated Pulse Waveform 
Between Two Servers in a Network" 

"Method for Clustering Software 
Applications" 



Application No. Attorney Docket 

No. 

MNFRAME.031A 



MNFRAME.032A 
MNFRAME.033A 
MNFRAME.034A 
MNFRAME.035A 

MNFRAME.036A 

MNFRAME.037A 

MNFRAME.040A 

MNFRAME.041A 

MNFRAME.042A 

MNFRAME.043A 

MNFRAME.044A 
MNFRAME.045A 
MNFRAME.046A 
MNFRAME.047A 

MNFRAME.048A 
MNFRAME.049A 
MNFRAME.050A 
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Title 

"System for Clustering Software 
Applications" 

"Method for Automatically 
Configuring a Server after Hot Add of 
5 a Device" 

"System for Automatically Configuring 
a Server after Hot Add of a Device" 

"Method of Automatically Configuring 
and Formatting a Computer System 
10 and Installing Softv^are" 

"System for Automatically Configuring 
and Formatting a Computer System 
and Installing Software" 

"Determining Slot Numbers in a 
15 Computer" 

"System for Detecting Errors in a 
Network" 

"Method of Detecting Errors in a 
Network" 

20 "System for Detecting Network Errors" 

"Method of Detecting Network Errors" 

RJS-3384:sad 
093097 



Application No. Attorney Docket 

No, 

MNFRAME,051A 



MNFRAME.052A 

MNFRAME.053A 
MNFRAME,054A 

MNFRAME.055A 

MNFRAME,056A 

MNFRAME.058A 

MNFRAME.059A 

MNFRAME.060A 
MNFRAME.061A 
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